%'^/pH3 ^ 09/446738 
' ' ' ' PCT/1L98/00297 



WO 98/59525 

1 430 ReJd PCT/PTO ? 3 DEC 1999 
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FIELD OF THE INVENTION 
The present invention relates to the field of headphones for the provision of surround 
sound in audio reproduction systems. 

BACKGROUND OF THE INVENTION 
The capabilities of the simple Hi-Fi stereo system have been extended recently to 
incorporate the surround sound effects required by home theater systems. Such systems 
include a large-screen television receiver or video cassette player, four additional speakers, 
and a surround amplifier. The new system dramatically improves the immersion of the viewer 
in the sound effects of the movie. 

A typical home theater system combines video capabilities with advanced audio 
systems, and it is based on the following major components: 

1. A large screen TV receiver or video projector. 

2. A laser disk player or a Hi-Fi video cassette player, which is the source of the audio and 
video signals. The audio track recorded on the fihn is not an ordinary stereo track. It 
encrypts additional information about the sound channels. Tlie encryption protocols have 
evolved over the years. There are three major standards currently in use: 

a. Dolby ProLogic Surround, in which in addition to the standard left and right channels, 
a center channel and a rear channel are recorded on the sound track. All channels are 
analog. 

b. THX, manufactured by the Lucas film company, in which two separate rear channels 
are used instead of one. All chaimeis are analog. 

c. AC-3. the latest development by Dolby lab, in which six channels of music are 
digitally recorded on the sound track - front nght, front left, center, rear right, rear left 
and subwoofer. The latter is not a fiill spectrum channel, as only one octave is 
necessary. 

3. A surround amplifier, for extracting the surround channels from the incoming signal. 
Surround amplifiers are typically based on the Dolby chip. Most amplifiers have DSP 
(Digital Signal Processor) capabilities, which can modify the sound of a non-surround 
music source to sound as if it originates from different artificial acousric environments, 
such as a concert hall, a theater, a jazz club, etc. 
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4. Speakers. A full surround system requires six different speakers, which must be of high 
quality to ensure realistic reproduction. Their function is as follows: 

a. Two main speakers, which reproduce most of the sound and music effect 

b. One center speaker, located above or below the screen. This speaker is dedicated to the 
actors' voices. 

c. Two rear speakers, responsible for the special effects generated by the surround sound 
system, and for the artificial echo effects generated in the different DSP modes of the 
surround amplifier. 

d. A subwoofer, for reproducing all low frequency sounds, such as explosions. Location of 
the subwoofer is not critical, as this channel contains little directional information. 
Furthermore, such low frequency sound v/aves are felt by many parts of the body, and not 
specifically by the ears. The subwoofer is usxially placed in the front field. 

The room itself has to be modified to fit the home theater requirements: 

a. Since there are six different sound sources in the room, any unwanted echo destroys the 
sound qiiality and directionality. The room must therefore be covered with acoustically 
absorbing materials, such as carpets and drapes. 

b. Acoustical isolating materials must be used to avoid disturbing neighbors. 

c. Wiring to the various speakers must be installed in the room, preferably without being a 
visual eyesore. 

Each of the system elements affects the overall sound quality. The most important 
factor is the room acoustics. If the room is big and the walls bare, the echo severely affects 
the sound. The quality of the speakers is also a major element of the system. High 
performance speakers are large and expensive, but essential for good sound. Finally, the high 
power, low distortion amplifiers required for realistic surround sound are expensive. 

These requirements make high quality surround sound systems very expensive both to 
purchase and to install in the home. 

In order to provide high quality audio reproduction at low cost and at a personal level of 
listening, conventional Hi Fi audio systems have for a long time made use of stereo 
headphones. Attempts to utilize headphones to provide sinround sound have been made by a 
number of manufacturers with limited success. In order to appreciate the problems involved 
in achieving an effective implementation of surround sound headphone technology, it is 
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dimensional hearing. 

In order ro recogniz=-the direction of a sound, «,e brain combines infonnatio. received 
by ti,e nvo ears and uses severaj psych<«cousdc effects to achieve a 3.D sensahon of the 

surrounding world, as follows: 

1. Phase difference: The sound does no, reach both ears in the same phase - the ear closer to 
the sound source hears the sound iirs. By calculating the minute difje,^„ces in dme of 
amval of the sound at the two ears ( <1 msec.), the brain can detea the origin of the 
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2. Level difference: Tl,e ear closer to the sourtd source hears a louder sound TOs 
informanon is converted by the brain into directional and range information. 

3. Head ^tadon: If. for example, the sound sou,^ .s directly in front of or directly behind 
the hstener. the phase and level difference between the two ears is zero. The body executes 
small, ahnost unnoticeable head movements in order to identify the origin of a som,d. 
Even the smallest movemem creates phase differences stgniiicant enough for the brain to 
oiscem the onentation of the source. 

4. Doppler pitch difference: During head rotatiot. the sound pttch changes due to the 
Doppler effect. The ear which rotates towards the source bean a slightly higher pitch than 
the other one. The brain ts capable of detecting thts slight change m pitch, and decoding 

-u the source direction from diis information. 

5. Face blockage: Whtle rotating the head away front the sound source, at a cenatn angle 
.he hstener s head causes one ear to move into the ••acoustical shade area" from the sound 
source, and the sound level ,„ th,s ear becomes lower than in the other one. The brain uses 
this effect to locate the sound origin point. 

5 -he most important, but m order to get a perfect illuston all 

five have to be reproduced correctly. When surround sound is produced by an arrav of 
^peaicers, the sound field produced is ve„ similar to that present in real life, and d,e human 
bram ,s able to make use of all five of the above effects to appreciate a,e sound 

The use of headphones, however, effectively eliminates all five of the above effects 
present ,n free space propagation, since the sound originates from highly localized 
transducers close to the listenefs ears. As the Hstener moves or „^s his head, the 
headphones move together w,th the Itstener's bead. TTe use of simple binaural audio signals 
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do not therefore give a perception of realism, since the sound field moves with the listener's 
head. In order to create a true surround sound effect, the audio signal supplied to the 
headphones must be coded in a sophisticated manner in order to simulate all five of the 
above psycho-acoustic effects as the listener moves while listening to the performance or the 
fihn. 

Japanese Unexamined Patent Publication No. Sho 42-227 and Japanese Examined 
Patent Publication No. 54-19242 describe a surround sound headphone system including a 
gyro compass or a magnetic needle compass installed on the headphones to measure head 
movement and to transmit information about head position to a microprocessor. This 
microprocessor modifies the sound track signal according to the head angle, and transmits 
the modified signal back to the headphones, so that the listener experiences a surround soxmd 
effect. Such a system, using a gyroscope mounted in the headphones, has been marketed by 
the Sony Corporation. In U.S. Patents 5,181,248 (corresponding to EP 438281), 5,452,359 
and 5,495,534, a further development of this system is described in which the gyroscope is 
replaced by an ultrasonic ranging system. The angular location of the head is obtained from 
relative time-of-arrival measurements of an ultrasonic reference signal emitted by a 
transmitter located in front of the listener, by means of ultrasonic detectors located in the left 
and right arms of the headphone set. As previously, a microprocessor modifies the sound 
track signal according to the measured head angle and transmits the modified signal back to 
the headphones, so that the listener experiences a surrovmd sound effect. 

In a further system, developed by Virtual Listening Systems Inc. and described in 
Stereo Review, p. 38 (April 1997), head movements are ignored completely. The surround 
sound effects from typical audio situations are pre-programmed by algorithms which provide 
the phase shifts and volume changes corresponding to various situations. This system 
therefore simulates the surround sound effect by digital processing means. 

German Patent 26 52 101 discloses a device with wireless transmission of a soimd 
signal to a headphone by means of a transmitted carrier. Two reception elements are 
attached to the pair of headphones so as to afford directing characteristics close to that of 
human hearing. 

European Patent Application No. EP 705053 describes a headphone for surroxmd 
soimd effect having two earphone members, each being provided with at least two 
loudspeakers arranged facing and forward of, or adjacent to, the piruia of the listener's ear. 
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All of the above-mentioned prior art systems use advanced real-time signal 
processing to modify the audio signal inforaiation. But the speed of available processors is 
such that they are unable to process the signals effectively, and the subjective results are 
unsatisfactory for a number of reasons: 

a. The systems deal^ only with the main psycho-acoustic parameters affecting 3-D 
recognition, namely, the first two, or at best three, in the list above. They all ignore the 
other, usually neglected, yet important, effects of Doppler pitch change effect and face 
blockage. 
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b. The relatively slow signal sampling rate results in an unnatural "metallic sound". 

c. The currently available real time computing used is not fest enough. If the listener turns his 
head too fast, the computing delay is clearly discerned and disturbing. 

d. In both the above mentioned commercially marketed systems, RF is used for 
communication between the headphones and the processor. KF is prone to interference 
from external sources such as cellular phones, radio ti^mitters or even a second 
headphone system nearby. Conversely, RF can interfere with other such systems. 

e. The processor can only deal with one set of headphones. In order for a second listener to 
enjoy the movie, a complete second system needs to be purchased. 

f. Because of the complexity of the systems, they are expensive. 

Therefore, it would be desirable to provide a headphone surround sound system which 
overcomes the disadvantages of the prior art technology, in that: 

a. 0 takes into consideration all five physiological aspects of 3-D sound appreciation, to 
J|rovide perfect surround illusion; 

b. =1 provides excellent sound quality, without any hesitation or metallic-sounding effects; 

c. is useable by several listeners, each listener requiring only a separate pair of headphones, 
^1 being controlled Sy one processing imit; 

d. sit is reasonably priced, and 



e. i| does not use mterference -prone RF communication channels. 

SUMMARY OF THE INVENTION 



IJI The present invention seeks to provide an improved headphone surround sound svstem 
There is thus provided in accordance with a preferred embodiment of the present 
invention a set of headphones, having earpieces each of which is equipped with an ultrasound 
detector for picking up the modulated audio signal information on an ulttasound wave 
transmitted into the listening area from an ultrasound transmitter, above-mentioned 
information being derived from the processing and modulating of an audio signal, so as to 
simulate the effects of surround sound. The processing and modulating of the audio signal is 
executed by an array of delay lines and modulators, connected and constructed such as to 
code the audio signal inputted to the earpieces with a simulation of the physiological effects 
that would be felt when listening to the audio signal propagated in free space. 
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It is noted that throughout the specification and claims, the tenn "headphone" 
encompasses not only headphones, but also any other apparatus for listening via the ears, such 
as a virtual reality helmet, for example. 

There is also provided in accordance with another preferred embodiment of the present 
invention, a wireless headphone assembly including at least one ultrasound receiver for 
receiving at least one ultrasound signal along at least one ultrasound chaimel, and at least one 
transducer for converting each of the at least one ultrasound signal along the at least one 
ultrasound channel to a human audible signal. 

Additionally, there is provided in accordance with yet another preferred embodiment of 
the present invention, a wireless headphone assembly wherein said at least one ultrasound 
receiver includes two ultrasound receivers, each of which receives an ultrasound signal along 
two ultrasound channels. 

There is further provided in accordance with still another preferred embodiment of the 
present invention, a wireless headphone assembly wherein the at least one ultrasoimd receiver 
includes four ultrasound receivers, each of which receives an ultrasound signal along one 
ultrasound channel. 

There is also provided in accordance with yet another preferred embodiment of the 
present invention, a wireless headphone assembly and wherein the at least one transducer 
includes at least one first transducer which converts the at least one ultrasound signal to at 
least one modulated electrical signal and at least one second transducer which converts the at 
least one modtilated electrical signal to a human audible signal. 

In addition, there is provided in accordance with another preferred embodiment of the 
present invention, a wireless headphone assembly and wherein at least one transducer 
comprises at least one multichannel transducer. 

There is also provided in accordance with yet another preferred embodiment of the 
present invention, a wireless headphone assembly including at least one band pass filter 
associated with each ultrasound channel. 

There is further provided in accordance with still another preferred embodiment of the 
present invention, a wireless headphone assembly including at least one demodulator 
associated with each ultrasound channel. 

In addition, there is provided in accordance with a fiirther preferred embodiment of the 
present invention, a wireless headphone assembly and wherein the at least one first transducer 
operative to convert the at least one ultrasound signal to at least one modulated electrical 
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signal, includes at least two first transducers, each arranged to be located adjacent to a 
different ear of a user. 

There is further provided in accordance with yet another preferred embodiment of the 
present invention, a wireless headphone assembly wherein the at least one second transducer 
includes at least two transducers, each providing a human audible output to a different ear of 
a user. 

In addition, there is provided in accordance with another preferred embodiment of the 
-present invention, a wireless headphone assembly wherein a human audible signal derived 
from ultrasound signals received at each of the at least two ultrasound receivers is supplied to 
each ear of a user. 

There is also provided in accordance with yet another preferred embodiment of the 
present invention, a wireless headphone assembly and wherein the at least two ultrasound 
receivers each receive ultrasound signals along at least two ultrasonic channels, the at least 
two transducers convert ultrasound signals along at least two himian audible channels to 
human audible signals, and information received along each one of the at least two channels 
of each of the at least two ultrasound receivers is supplied to each of two different ears of the 
user along a separate one of the human audible channels. 

There is further provided in accordance with still another preferred embodiment of the 
present invention, a wireless headphone assembly including delay lines operative to simulate 
the acoustic delay occurring between the arrival of sound from at least one signal source at 
different ears of the user. 

In addition, there is provided in accordance with yet another preferred embodiment of 
the present invention, a headphone system providing a simulated multi-source sound 
environment including at least one wireless headphone assembly which may be worn by a 
user and which includes at least one ultrasound receiver for receiving at least one ultrasound 
signal along at least one ultrasound channel and at least one transducer for converting each of 
the at least one ultrasound signal along the at least one ultrasound channel to a human audible 
signal, and at least one processor receiving a multi-source signal and modulating the sound 
earner along the plurality of channels in accordance with the multi-source signal, and at least 
one transminer for transmitting the modulated sound carrier to the pair of headphones along a 
plurality of channels. 

In addition, there is provided in accordance with yet another preferred embodiment of 
the present invention, a headphone system wherein the use of ultrasoimd for transmitting the 



wo 98/59525 




wo 98/59525 PCT/IL98/00297 

8 

modulated carrier to the at least one headphone is operative to cause a listener using the 
headphone to experience the psycho-acoustic effects that he would experience if the multi 
source signals were transmitted in free space as audible sound waves from suitably located 
sound sources. 

There is further provided in accordance with yet another preferred embodiment of the 
present invention, a method for simulating an artificial soimd environment including 
converting an audible signal to an ultrasound wave, receiving the ultrasound wave by means 
of a wireless headphone assembly, and converting the ultrasound wave to an audible signal by 
means of the wireless headphone assembly. 

There is also provided in accordance with a preferred embodiment of the present 
invention a method for simulating an artificial sound environment including sending an 
ultrasound reference signal to a headphone assembly worn by a user having two ears, the 
headphone assembly audibly providing at least one audio signal to each of the ears, 
processing arrival times of the ultrasound reference signal at each the ear, so as to measure a 
phase difference of the signal as perceived by one the ear in contrast to the other ear, 
modulating at least two audio signals, at least one signal for each the ear, in accordance with 
the phase difference, and sending the at least two audio signals via the headphone assembly to 
each of the ears. 

In accordance with a preferred embodiment of the present invention the method also 
includes sending the at least two audio signals and the ultrasound reference signal via an 
ultrasound carrier. 

Further in accordance with a preferred embodiment of the present invention the step of 
sending the at least two audio signals includes sending the signals to the headphone assembly 
by wired communication. 

Still further in accordance with a preferred embodiment of the present invention the 
step of sending the at least two audio signals includes sending the signals to the headphone 
assembly by wireless communication. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully from the following 
detailed description, taken in conjunction with the drawings in which: 

Fig. I is a pictorial representation of a prior art conventional speaker-based surround 
sound system, showing the component pans and their mutual location; 
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Figs. 2A and 2B illustrate how, in the prior art conventional speaker-based surround 
sound system, the listener detects the direction from which a sound emanates by discerning 
the small time difference between receipt of the sound by the ear closer to the origin, and by 
that further from the origin; 

Figs. 3 A and 3B show how, in the prior an conventional speaker-based surround sound 
system, the listener detects the direction from which a soimd emanates, and by rotating his 
head towards the sound origin, equalizes the phase of the sound heard by both ears; 

Fig. 4A and Fig. 4B present the timing sequence of the receipt of the sound by the left 
and right ears of a listener seated in front of a conventional prior art surround sound system, 
and how the timing sequence changes when he rotates his head towards the sound origin and 
equalizes the phase of the sound heard by both ears; 

Fig. 5 is a pictorial representation of a headphone-based surround sound system 
constructed and operative in accordance with a preferred embodiment of the present 
invention; 

Fig. 6 is a block diagram of an encoder unit constructed and connected in accordance 
with a preferred embodiment of the present invention, showing how the five separate inputs 
from the surround sound audio signals are inputted through delay lines and modulators to 
provide the correct mixture of signals for outputting to the ultrasound transmitter; 

Fig. 7 is a schematic biock diagram of a pair of headphones constructed and operative 
in accordance with a preferred embodiment of the present invention, showing the components 
and their interconnections required to receive, demodulate and convert the ultrasound signals 
emitted by the system transminer to audible signals to be perceived by the listener as 
surround sound; 

Figs. 8A and 8B illustrate how a surround sound headphone system constructed and 
operative in accordance with a preferred embodiment of the present invention simulates the 
phase difference psycho-acoustic effect in order to enable the listener to detect the direction 
from which a sound emanates; 

Figs. 9 A and 9B show how a surround sound headphone system constructed and 
operative in accordance with a preferred embodiment of the present invention simulates how 
the listener detects the direction from which a sound emanates, and by rotating his head 
towards the sound origin, equalizes the phase of the sound heard by both ears; 

Fig. lOA and Fig. lOB illustrate the timing sequence of the receipt of the sound by the 
left and right ears of a listener using a surround sound headphone system constructed and 
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operative in accordance with a preferred embodiment of the present invention, and shows 
how the timing sequence changes when he rotates his head towards his perception of the 
sound origin, and equalizes-the phase of the sound heard by both his ears; 

Fig. 1 1 illustrates how listeners seated over extiensive areas of a room equipped with a 
surround sound headphone system constructed and operative in accordance with a preferred 
embodiment of the present invention all have the correct spatial illusion of the surround 
sound; 

Fig. 12 is a schematic block diagram of a headphone-based surroimd soxmd system 
constructed and operative in accordance with another preferred embodiment of the present 
invention, wherein the ultrasound signal of the embodiments of Figs. 5-11 is used as a 
reference signal and the audio signals are sent by wired or wireless conmiunication to the 
headphones; and 

Fig. 13 is a schematic block diagram of a headphone-based surround sound system 
constructed and operative in accordance with yet another preferred embodiment of the 
present invention, this system being substantially the same as the system illustrated in Fig. 12, 
except that wherein the system of Fig. 12 is a stand-alone system, the system of Fig. 13 is 
suitable for packaging as a printed circuit board in a personal computer. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

A preferred embodiment of the present invention is described in the field of surround 
sound systems. However, it is appreciated that the present invention is readily applicable for 
use in other applications such as virtual reality systems, computer games, simulator systems, 
and the like. 

Reference is now made to Fig, 1 which is a pictorial representation of a prior art 
conventional speaker-based surround sound system, as described in the "Background to the 
Invention", showing the component parts and their mutual location with respect to the 
listener. The parts shown are a TV receiver or video screen 10, an audio signal source 12, 
such as a laser disk player or video cassette player, the surround sound amplifier 14, the main 
speakers, namely the front left speaker 16 and the front right 17, the center speaker 18, the 
rear left speaker 20, and the rear right speaker 21. In this representation, only the five 
speakers which provide the directional information are shown. The sub-woofer is xmderstood, 
and its location is not critical. The listener 22 is shown seated at the "sweet spot", the only 
area in the room where the surround sound effect is felt realistically. 
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Figs. 2A and 2B show how a listener 22 seated in front of a prior an speaker-based 
surround sound system is able to detect the direction from which a sound emanates by 
discerning the small time difference between receipt of the sound by the ear closer to the 
origin, and by that further from the origin. In Fig. 2A, a sound wave 30 coming from the right 
5 from speaker 17 is shown impinging first on the hstener's right ear 32. In Fig. 2B, the sound 
is shown hitting his left ear 34 a shon while later, typically 0.3 msec for a signal emanating 
30° off axis. 

Figs. 3A and 3B are illustrations of the method by which a listener 22 seated in front of 
a prior art speaker-based surround sound system detects the direction from which a sound 
10 emanates, and by rotating his head towards the sound origin, equalizes the phase of the sound 
heard by both ears. 

In Fig. 3 A, a sound wave 30 coming from the right front speaker 17 is shown impinging 
on the listener's ears, with a small time delay between the moment of impingement on the left 
S ear as compared with the right ear. In Fig. 3B, the listener 22 has turned his head in the 
JS <^^^^c^^on of the sound origin, and is able to detect this direction by mentally discerning when 
01 the sound is received by both ears at the same time. 

y I Fig. 4A shows a quantitative depiction of the timing sequences for Figs. 2A and 2B, for 

the arrival of the sound at the left and right ears of a listener seated in front of a prior art 

C) surround sound system. The horizontal axis represents the time elapsed during the 
20 ^ propagation of the sound, waves. Fig. 4B shows the same timing sequences for the situation 
depicted in Figs. 3A and 3B, where the listener turns his head towards the sound source 

Q In Fig. 4A, the sound wave is depicted leaving the speaker 17 at time to and arriving at 

the listener's right ear after a time to ^ DIUV, where V is the velocity of the sound, and DR is 
the distance from the speaker to the right ear 32. The sound arrives at his left ear only after a 
5 time to + DL/'V, where DL > DR. The listener's brain discerns this slight delay to locate the 
origin of the sound. 

In Fig. 4B, the listener is shown after rotating his head towards the sound origin. The 
timing sequence shows how the sound wave leaves the speaker 17 at time t, and arrives at 
both of the listener's ears after a time tj-n DRTV, which is identical to DL^, since the 
0 distance from the speaker to the two ears is equal. 

A pictorial representation of a surround sound headphone system, constructed and 
operative in accordance with a preferred embodiment of the present invention, is shown in 
Fig. 5. It is seen that the five speakers shown in the conventional prior an system of Fig. I 
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have been eliminated. In their place are three small-size components, which comprise the 
basic components of the headphone surround sound system. These components are a surround 
sound encoder 24, an ultrasound transducer 26, and a set of surround sound headphones 28. 

The surround sound encoder 24 is provided with an input signal from the audio signal 
source 12 - a laser disk player, a VCR , or any other stereo source. The unit can be connected 
to a surround sound amplifier 14, such as an external Dolby processor, or it can be fitted with 
its own internal surround processor. The encoder 24 processes the five conventional separated 
surround sound channels. The modified signal is then modulated, by AM or FM for example, 
and amplified to bring it to a sufficient level for transmission. The simulation of different 
sound sources is made by using four different carrier frequencies on one transmitted 
ultrasound beam. Two are used to simulate the front sound sources and two for the rear 
sources. 

It is appreciated that even though the described embodiment of this invention is 
constructed and operative to handle signals coded according to the Dolby recording standard 
it can easily be adapted to any other 3-D sound recording standard 

The modulated and amplified signal is fed to the ultrasoimd transducer 26, mounted on 
top of the TV receiver, and transmitted into the listening room in the form of coded 
ultrasound waves containing the surroimd soimd signals. 

It is appreciated that even though the described embodiment of this invention is 
constructed and operative to convey all of the audio information by one transmitter, it can 
easily be adapted to transmit via several transmitters such as one for rear channels and one for 
front chaimels. 

The surround sound headphones 28 worn by the listener contain two special 
microphones mounted on each ear-piece, which receive the ultrasoimd signals transmitted 
from on top of the TV monitor. Four decoders convert the signal into audio surround sound, 
which is then amplified and reproduced by the headphones' speakers. Each ear-piece is 
sensitive to two frequencies - one front and one rear. 

The propagation effects of the above described system are now explained. Since 
ultrasoimd is a normal sound wave but of super-audible frequency, it propagates through air 
in exactly the same manner as any other sound wave. It is therefore the specific use of an 
ultrasound reference signal sent from the transmitter to the listener's head, which enables the 
surround sound effect produced by the present invention to behave exactly like the audio 
sound produced by a conventional free space surround sound system. (In the embodiment of 
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Fig. 5, the ultrasound signal is not only used as the reference signal but also as the carrier 
signal for the audio infonnation. In another preferred embodiment of the present invention, 
described hereinbelow with reference to Figs. 12 and 13, the ultrasound signal acts only as the 
reference signal and the audio information is transmitted separately by wired or wireless 
communication.) 

In particular, all the parameters affecting normal hearing are applicable to ultrasound 
with respect to the five psycho-acoustic effects mentioned above: 

L The velocity of the ultrasound carrier generates an accurate phase difference between the 
listener's two ears. 

2. The level of the ultrasound carrier causes the correct transduced sound volume differences 
between the two ears. 

3. No special consideration need be given to measuring head movements. The ultrasound is 
affected by head movements exactly like audible sound signals. 

43;^. The Doppler effect changes the pitch with head rotation in exactly the same way as if real 
1 ^ fli speakers were being used. 

yj- Due to the location of the ultrasonic receivers on either side of the headphone amis, the 
face blockage effect is retained. 

further advantage of the use of ultrasound is that, unlike RF, the envuronment does not 
pnterfere with the transmission, giving rise to a noisy signal, nor does the transmission cause 

20 pinterference to the environment. 

Q 

Q Fig. 6 shows a schematic block diagram of the encoder unit. This unit modifies the 
signals from each of the five conventional surround sound input channels 40 - front left, fi-ont 
right, center, rear left and rear right - by means of delay lines 42, operative on the signals 
according to their source channel and their destination channel. The resulting signal 
5 information is routed into four output channels - fi-ont left, front right, rear left and rear right - 
which are, for example, AM or FM modulated 44 onto four different carrier frequencies using 
a built-in local oscillator, and inputted to a mixer 46, whose output 48 is amplified for feeding 
to the ultrasound transducer. 

The five dirTerent input channels are processed and connected in the following manner. 
0 The center channel signal is fed directly to the Cn. and Cfr modulators for transmission by 
the two fi-ont channel carriers - Cn. and Cfr. The front right channel signal is fed in parallel 
to two channels - directly to the Cfr channel modulator, and to the Cpi modulator via a 0.3 
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msec, delay line (calculated for a sound source located 30** off center). The front left channel, 
in a manner similar to the right channel, is fed directly to the CpL channel modulator, and with 
a 0.3 msec, delay to the CpR modulator. The rear right channel signal is connected directly to 
the Crr modulator, and via a 0.3 msec delay line to Crl. The rear left chaimel signal is 
connected directly to the Crl modulator, and via a 0.3 msec delay line to Crr. 

In order to see how this method of encoding produces effective surround sound, it is 
necessary to understand how the decoding process is executed in the surround sound 
headphones. The construction of these headphones is shown in Fig. 7. 

The headphones are based on standard Hi-Fi headphones equipped with additional 
electronic components, as follows: two ultrasound microphones 50 and 52, four filters 53, 54, 
55 and 56, four demodulators 57, 58, 59 and 60, a pair of amplifiers 61 and 62. These 
amplifiers feed the speakers 63 and 64 of the headphones. The two ultrasound microphones 
50, 52, are located one on each ear-piece, on either side of the earphone bridge 65, and act as 
receivers for the transmitted ultrasound signals. The signals from each of these microphones 
are filtered and demodulated to extract the two channels, front and rear, associated with each 
ear. The resulting signals are amplified and fed to each ear-piece's speaker, which transduce 
them to human audible signals. 

Each microphone is coimected to both ear-pieces as follows. The front carrier is 
connected directly to the ear-piece on the side on which the microphone is mounted, and the 
rear carrier to the opposite ear-piece. Specifically, for the front channels, the right 
microphone transmits Cfr to the right ear and the left microphone transmits Cfl to the left 
ear. For the rear chaimels, the cormections are crossed such that the right microphone 
transmits Crl to the left ear and the left microphone transmits Crr to the right ear. Using this 
crossed-coraiection, any sound source in any direction can be simulated using only one 
ultrasonic transmission. In particular, rear sound sources are correctly simulated using one 
transmitter located in the front 

Figs. 8A and 8B illustrate how a surround sound headphone system constructed and 
operative in accordance with a preferred embodiment of the present invention simulates the 
phase difference psycho-acoustic effect, enabling the listener 22 to detect the direction from 
which a sound seems to emanate. In Fig. 8A, two front channel signals Cfr and CpL are sent 
out by the transmitter 26, but with a slight time delay between them. The Cfl signal is delayed 
by about 0.3 msec comparing to Cfr. Because of the direct pickup and connection in the 
earphones, the listener 22 hears the sound first in his right ear 32, and only 0.3 millisecond 
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later, as shown in Fig. 8B, in his left ear 34. It seems to the listener as if a virtual speaker 36 is 
located on his right side at about 30**. 

Figs. 9A and 9B demonstrate how the surround sound headphone system enables the 
listener to detect the direction from which a soimd emanates by rotating his head towards the 
sound origin in order to equalize ±e phase of the sound heard by both ears. The figure 
nomenclature is the same as in Figs. 8A and 8B. If the listener rotates his head to the right, the 
delay between the signals Cn. and Cfr decrease until his head is turned 30*' to the right. At 
this point, the delay is zero and the listener has the illusion of looking directly towards the 
origin of the sound, as illustrated in Fig. 9B. 

Figs. lOA shows a quantitative depiction of the timing sequences for Figs. 8 A and 8B, 
for the arrival of the sound at the left and right ears of a listener using a surround sound 
headphone system. The horizontal axis represents the time elapsed during the propagation of 
the sound signals. Fig. lOB shows the same timing sequences for the situation depicted in 
Figs. 9A and 9B, where the listener rums his head towards the sound source. 

In Fig. lOA, the front right signal Cfr leaves the transmitter 26, at time t^ and arrives at 
the listener's right ear after a time t^ ^ DRA^, where V is the velocity of the sound, and DR is 
the distance.from the transmitter to the right ear 32. The front left signal Cfi leaves the 
transmitter 26, at time ti and arrives at the listener's left ear after a time t] DITV. Since DR 
= DL when the listener is looking forward, the sound arrives at his left ear a time ti - t^ later 
than at his right ear, and the listener's brain discerns this slight delay to locate the origin of 
the sound as if it were to the right of him at about 30**. 

In Fig, lOB. the listener is shown after rotating his head towards the sound origin in an 
attempt to localize its direction. The timing sequence shows how, even though they were 
transmitted a time ti - v apart, the Cfr and C^l signals both seem to arrive at the listener's 
ears at the same moment, after a time l^-^ DR/V, equal to ti+ DLA^, and give the listener the 
illusion as if they originated from the direction towards which he turned his head, namely his 
front right hand side at about 30°. 

The reason for the crossed connecrion for the rear channels in the headphones is now 
clear. If a real sound source is located in front of the listener, by turning his head to the right 
for example, his right ear moves ftirther from the source, while his left ear moves closer to it. 
If on the other hand, the source is located behind him, the effect is opposite, in that by turning 
his head to the right, for example, his right ear moves closer to the source, while his left ear 
moves ftinher from it. Thus, sources located behind the listener behave as if they were left-to- 
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right reversed in comparison to those in front of him. The headphones implement this effect 
by crossing over the rear connections as shown in Fig. 7, 

Several listeners 70, 71, 72, are shown in Fig. 11, sitting in a room equipped with the 
headphone surround sound transmission system 73. So long as they each have a headphone 
set, they all have the illusion of complete surround sound, as if a "center speaker" were 
located in the direction of the TV receiver, and four additional speakers located around each 
of them in perfect locations. The front virtual speakers are located 30° left and 30*" right of 
the TV set, and the rear speakers, 30° rear left and 30° rear right. In this respect, there are 

A preferred embodiment of the present invention includes a headphone surround sound 
system having many advantages comparing to prior art speaker-based surround sound 
systems. These advantages are summarized as follows: 

1. Surround headphones are considerably cheaper, since : 

a There is no need to cover the room with acoustic absorbing and isolating materials, 
b The need for expensive, space consuming speakers is eliminated, 
c Expensive high power amplifiers are not needed, 

2. In most cases, surround headphones provide the listener with improved sound quality and 
better inmiersion, since: 

a. The acoustic enviroimient is perfecr, since there are no unwanted echoes or external 
noises. 

b. Because of the low power levels involved, headphones have a considerably lower 
distortion level than speakers in the same quality class. 

c. Since headphones are very close to the listener's ear, they require only a low power 
amplifier to drive them, and these too have a considerably lower distortion level than 
high power amplifiers. 

d. In standard home theater rooms, only a small listening area in the middle of the room, 
called the "sweet point*', is optimum for experiencing the surround sound effect fully. 
Using surround sound headphones, this area is much more extensive. 

3. Headphones are more convenieni lo use, since: 

a. Every room is suitable for watching surround sound movies, and there is no need to 
dedicate a special room to this purpose. 
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b. There is no need to extensively wire the listening room. 

c. The listener can use high volume sound reproduction without bothering others. 
Reference is now made to Fig. 12 which is a schematic block diagram of a headphone- 
based surround sound system constructed and operative in accordance with another preferred 
embodiment of the present invention. In the system of Fig. 12, the ultrasound signal of the 
embodiments of Figs. 5-11 is used as a reference signal and the audio signals are sent by 
wired or wireless communication to the headphones. Accordingly, only the audio processing 
portion of the system is illustrated and described with reference to Fig. 12, the ultrasound 
reference signal being as described hereinabove with reference to Figs. 5-11. 

An analog-to-digital converter 102 receives analog audio signals, such as from 5 x 
PreAmp Surround or any other kind of analog stereo input. The audio signals contain, for 
example, the information corresponding to front right, front left, center, rear right, rear left, as 
described hereinabove. The signals are then sent for processing, preferably via a data 
controller 104, to a signal processor 106. Signal processor 106 may be packaged as an FPGA 
(Optionally, data controller 104 may receive a digital audio input, such as digital AC-3 input 
via an AC-3 decoder 114.) 

In order to process the signals, ultrasound transducer 26 (Fig. 5) sends an ultrasound 
reference signal to ultrasound microphones 50 and 52 (Fig. 7). A head angle calculator 120 
processes arrival times of the ultrasound reference signal at each ear, so as to measure a phase 
difference of the reference signal as perceived by one ear in contrast to the other ear, as 
described hereinabove. In this manner, head angle calculator 120 calculates the azimuthal 
angular movement a and elevational angular movement (3 of the head. The angular 
movements are sent by data controller 104 to signal processor 106 for modulating the audio 
input in accordance with the phase difference, in order to provide the user with the correctly 
directed sound, as described hereinabove. 

Alternatively, a head sensor 1 16 may be provided, for example, mounted on surround 
sound headphones 28 worn by a user, which senses movement of the head of the user. For 
example, head sensor 116 may sense azimuthal angular movement and elevational angular 
movement of the head, and send the sensed data to head angle calculator 120 via a head 
sensor interface 118, such as an amplifier. An input switch 122 may be provided for selecting 
and switching between the kind of inputs available, ultrasound, or non-ultrasoimd. 

The signal processing may be carried out by any known method, such' as, but not 
necessarily, FIR (finite impulse response). As seen in Fig. 12, during the course of signal 
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processing, signal processor 106 may cooperate with an input buffer 108 and a memory 
device 109. Input buffer 108 may be any kind of suitable buffer, such as a fast RAM (20 ns, 
5K X 16 bit). Signal processor 106 may comprise a decoder, such as a ProLogic Decoder, if it 
is required to decode the signals. 
5 Preferably signal processor 106 cooperates with input buffer 108 in the following way. 

It, for example, an audio input is coming from 0° with respect to the listener (i.e., directly in 
front of the listener) or if it is desired to artificially mimic an audio input coming from 0**, 
then signal processor 106 takes the audio input for each ear at the same time from buffer 108. 
However, if an audio input is coming from 30° with respect to the listener, or if it is desired to 
artificially mimic an audio input coming from 30°, then signal processor 106 takes the audio 
input from buffer 108 for one ear, then watts a certain time delay corresponding to the delay 
that the listener would in real life sense between both ears, and only then takes the input for 
the other ear from buffer 108. 

The processed signals are preferably output to a D-A converter 110 which sends the 
processed signals to headphones 28 via an LNA 112, or alternatively or additionally to a 
stereo speaker or subwoofer. 

It is important to point out that the embodiment of Fig. 12 is different from the prior art 
mentioned above in the background, namely, USA Patent Nos. 5,181,248, 5,452,359 and 
5,495,534. In the prior art, the angular location of the head is also obtained from relative 
time-of-arrival measurements of an ultrasonic reference signal emitted by a transmitter 
located in front of the listener, by -neans of ultrasonic detectors located in the left and right 
arms of the headphone set. However, the prior art can only measure angular changes in 
azimuth corresponding to sideway.s motion of the head. In contrast, the present invention can 
measure and respond to any kind of imgular motion, including elevation and roll and any 
combination of angular and linea r movement of the head. The prior art cannot measure 
distance between ears of the listener. This is a particularly imponant drawback because not 
every listener has the same size head and so the sound effects are different for each user. In 
contrast, the present invention does indeed measure the distance between the two ears of the 
user and modifies the audio input to the two ears accordingly, as described hereinabove. In 
addition, the prior art does not use an input buffer as does the present invention (input buffer 
108) as described hereinabove. 

Fig. 13 is a schematic block diagram. of a headphone-based surround sound system 
constructed and operative in accordance with yet another preferred embodiment of the 
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present inventiotL this system being substantially the same as the system illustrated in Fig. 12, 
except that wherein the system of Fig. 12 is a stand-alone systeni, the system of Fig. 13 is 
suitable for packaging as a printed circuit board in a personal computer. 

It will be appreciated by persons skilled in the art that the present invention is not 
limited by what has been particularly shown and described hereinabove. Rather the scope of 
the present invention includes both combinations and subcombinations of the various features 
described hereinabove as well as variations and further developments thereof which would 
occur to persons skilled in the art upon reading the foregoing description and which are not in 
the prior art. 



